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(57) [Abstract] 

[Object] This invention relates to a headphone apparatus and provides a 
headphone that enables a user to localize a sound. 
[Configuration] To enable sound localization by providing a plurality of 
speakers (1 to 9) that are driven independently in the right and left 
headphones (10L, 10R). Also a detection unit (13) that detects point by point 
a position and a direction of the sound localization headphone apparatus may 
be provided. Furthermore, corresponding to the position and the direction 
which the detection unit detects, and signal supply units (11, 12) that supplies 
drive signals to a plurality of sound generators to allow actual sound 
localization for a person who wears the headphone apparatus may be 
provided in conjunction with virtual-realjty visual apparatuses (14, 11, 12). 
Furthermore, a plurality of microphones (1" to 5") are arranged on the outside 
of each headphone, a plurality of s ^eakersj l to 5) are arrang ed o nJheJnside 
of e ach headphone in places corresponding wit h the micro phones, and a 
plurality of drive cir cuits (V to 5') are provided to amplify an elect rical signal 
representing the sound received by each microphone and to drive their 
respective sound generators. 
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[Scope of Claims for Patent] 

[Claim 1] A sound localization headphone apparatus, in which a plurality of 
sound generators (1 to 9), each driven independently, are arranged on the 
inside of the right and left headphones (L, R) to enable sound localization. 
[Claim 2] The sound localization headphone apparatus according to claim 1, 
comprising: a detection unit (13) that detects point by point a position and/or a 
direction of the sound localization headphone apparatus; and signal supply 
units (11, 12) that supply drive signals to a plurality of the sound generators 
based on the detected positions and/or directions in order to allow actual 
sound localization for a person with the headphone apparatus attached. 
[Claim 3] A virtual-reality audio-visual apparatus, comprising: the sound 
localization headphone apparatus according to claim 2; a head mounted 
three-dimensional viewing apparatus (14); and a computer (12) that outputs a 
virtual-reality visual signal to the head mounted three-dimensional viewing 
apparatus and outputs a virtual-reality audio signal to the headphone 
apparatus. 

[Claim 4] A sound localization headphone apparatus, comprising: a plurality of 
microphones (1" to 5") arranged on the outside of each headphone (L, R); 
a plurality of sound generators (1 to 5) arranged on the inside of each 
headphone in places that correspond to each of the microphones; and a 
plurality of drive circuits (V to 5*) that amplify an electrical signal representing 
the sound received by each microphone and drive their respective sound 
generators. 

[Detailed Description of the Invention] 
[0001] 
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[Industrial Applicability] The present invention relates to a headphone 
apparatus, and more specifically relates to a headphone apparatus 
comprising a plurality of speakers, each driven independently, inside the 
headphone to allow an user to perceive sound localization. 
[0002] 

[Prior Art] In a conventional headphone apparatus, a single speaker is 
provided for each of the headphones on the right and left and sound signals 
for the left and right are processed in advance based on distances from or 
directions of the sound sources in front, at the back, on the right or left, that is, 
adjustments are made to their amplitudes or phases to drive the left and right 
headphones, allowing the headphone apparatus user (hereinafter called 
"person") to perceive the sound localization. 

[0003] Detailed description of the signal processing follows. Recently 
intuitive interaction systems that utilize the "five senses" of human have been 
developed using the technologies such as artificial reality and virtual reality to 
address the demand for interaction between the person and the computer, 
namely a demand for man-machine interface. However, most of the 
interaction systems that have been previously developed are the visual 
perception oriented systems with the limited number of systems that utilize 
the auditory perception. 

[0004] While visual information may be considered the most important factor 
in the light of person's perception of reality, a perfect sense of reality can not 
be obtained effectively when solely depending on the visual perception. 
That is, the person perceives the reality using all the information obtained 
through every one of his/her five senses. 
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[0005] When consideration is given to the future personal interaction 
apparatus, a sound apparatus that enables the sound localization is desirable. 
With this apparatus, a direction of the sound or surrounding conditions is 
communicated effectively to the person with an enhanced sense of reality. 
For instance, by using a head mounted three-dimensional viewing apparatus 
called head mount display (hereinafter, "HMD") for the visual apparatus and 
using a headphone type sound apparatus that enables sound localization for 
the visual apparatus, one can experience a changing virtual space (landscape 
simulation, CAD/CAM etc.) in real time through the computer graphics (CG) or 
computer sounds (CS) and manipulate them intuitively. 
[0006] Furthermore, systems have been proposed in that the headphone 
apparatus is provided with a detection unit for detecting its direction and when 
the person changes its direction, input signals for the left and right 
headphones are processed based on the detected direction. 
[0007] 

[Means to Solve the Problems] Since in the conventional artificial perception 
audio apparatuses described above, standard stereophonic headphones are 
used, that is, the sound from each single speaker reaches each of the right 
and left ears, it is not always possible to obtain the reality precisely due to the 
sound propagation properties of the head (bone, ear shape, hair etc.) which 
differ among individuals. It also has a difficulty when an attempt is made to 
localize the sounds coming in every possible direction, because, for instance, 
the sound from forward is localized in the head and the sound from backward 
is localized at the upper position. 

[0008] It is an object of the present invention to provide a headphone 
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apparatus to ensure reliable sound localization under the conditions 

mentioned above. 

[0009] 

[Means to Solve the Problems] In the first headphone apparatus according to 
the present invention, a plurality of sound generators (speakers), each driven 
independently, are arranged on the inside of the left and right headphones. 
In the second and third headphone apparatuses according to the present 
invention, a detection unit that detects point by point a position and/or 
direction of the headphone apparatus is provided and the first headphone 
apparatus is provided with drive circuits that supply drive signals to a plurality 
of the sound generators based on the detected position and/or direction to 
enable actual sound localization for the person with the headphone apparatus 
attached. In the fourth headphone apparatus according to the present 
invention, a plurality of microphones are arranged on the outside of the 
headphones on the left and right, a plurality of speakers corresponding with 
each of the microphones are arranged on the inside of the headphones, and a 
plurality of amplifiers are provided to amplify an electrical signal representing 
the sound received by each microphone and drive their respective speakers. 
[0010] 

[Operations] Therefore in the present invention, sounds coming from forward 
to the person are inputted to his/her ears through the speakers located in the 
front side positions inside the headphones and, in similar manner, sound 
coming from backward to the person are inputted to his/her ears through the 
speakers located in the back side positions inside the headphones. The 
same holds true for the sounds coming from upward, downward, left, and right. 
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Therefore, sounds coming from forward, backward, upward, downward, left or 
right can be heard by the ears from forward, backward, upward, downward, 
left or right respectively making it possible for the person to perceive the 
sound localization regardless of his/her particular sound propagation 
properties of the head. 
[0011] 

[Embodiments] The first embodiment of the present invention is described in 
detail below with reference to Fig. 1, 2, and 5. In Fig. 1 (a), L and R 
represent the headphones on the left and right respectively and they together 
form a single unit headphone (10). Fig. 1 (b) is an inside view of one of the 
headphones where a plurality of small speakers, 13 speakers in this case, are 
installed. Numbers 1 to 5 represent five speakers arranged vertically in the 
center and numbers 6, 7, 3, 8, and 9 represent five speakers arranged 
horizontally in the center. Fig. 1 (c) represents a vertical sectional view of 
Fig. 1 (b). As shown in these diagrams, these speakers are arranged in the 
positions that surround either ear from upward, downward, left, and right by a 
certain distance to avoid a direct contact with the ears. A plurality of drive 
circuits 11, each connected to each of the speakers, are independent from 
one another and separate signals are inputted thereto from outside. 
[0012] Operations of the unit headphone 10 in conjunction with driving signals 
for each speaker is described with reference to Fig. 5. In Fig. 5 (a), a direct 
sound that is heard from forward as represented by the arrow is reproduced 
as a signal being delayed by its travel time for both left and right by the 
speakers 6 located in the front side positions as shown by the arrow. In Fig. 
5 (b), a sound coming from forward is reflected as it hits with the right side wall 
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as represented by the arrow and reproduced by the speaker 7 located in the 
front side position on the right as shown by the arrow as a signal of the 
primary reflected sound being delayed by its travel time and attenuated by an 
amount absorbed by the wall. In Fig. 5 (c), a sound coming from forward as 
represented by the arrow Is reflected as it hits with the right side wall and the 
back side wall and its secondary reflected sound is reproduced by the 
speakers 3 and 8 on the right as shown by the arrow being delayed by its 
travel time and attenuated by an amount absorbed by the walls. These 
sound sources and walls do not exist in real world and instead they are 
composed artificially by the computer 12. Computer 12 processes the 
inputted monophonic sound signals as described above then inputs the drive 
signals to each of the drive circuits 1 1 . 

[0013] The second embodiment of the present invention is described with 
reference to Fig. 3. In Fig. 3, a position and direction detection unit 13 is 
added to the unit headphone 10. This position and direction detection unit 
13 receives a radio wave sent, for instance, from a plurality of radio wave 
generators located outside and detects six pieces of information including 
spatial position information components (x, y, z) and spatial direction 
information components (yaw, pitch, roll) for the detection unit 13. To this 
end, those that have been used with the HMD for virtual-reality visual signal 
generation can be used. Computer 12 uses the information obtained from 
the detection unit 13 to output the virtual-reality visual signals to the HMD 14 
and corresponding sound signals to the drive circuits 11 respectively. By 
providing a combination of this unit headphone 10* and HMD 14, the person 
can perceive the changing virtual reality both visually and audibly at the same 
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time in response to his/her head movement. It allows the person to acquire a 
sense of reality more effectively as evidenced by the fact that when the 
person who listens to a sound from a certain point in real space with his/her 
eyes closed turns his/her head, his/her resolving capability to determine the 
sound source position gets better than that of when not turning his/her head. 
[0014] Although in the above description, the position and direction detection 
unit 13 that detects both position and detection was mentioned, one that 
detects either position or direction as necessary is possible as well. 
[0015] Next, the third embodiment of the present invention is described with 
reference to Fig. 4. Fig. 4 (a) is the unit headphone 10' comprising the left 
headphone U and the right headphone R' and Fig. 4 (b) is a vertical sectional 
view in relation to Fig. 1 (c). In the left and right headphones U and R\ in the 
positions outside of the speakers 1 to 5 shown in Fig. 1 (c), equal number of 
microphones 1" to 5" are provided. Sounds received by each of the 
microphones 1" to 5" are amplified by their respective drive circuits 1' to 5' to 
drive their respective speakers 1 to 5. 

[0016] A user of this headphone can hear an amplified actual sound without 
losing its directivity (sound image) in a way similar to when not using the 
headphone. In other words, it works like a hearing aid that can preserve the 
sound localization. 

[0017] In addition, by installing a plurality of microphones of the same form 
and configuration as the microphones 1" to 5" in other unattended place, 
simulating the motion of the person's head through a remote control in 
conjunction with the position and direction detection unit 13 and a video 
camera, which is not illustrated in the diagrams, that are deployed in the other 
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place, and reproducing the received sounds by the unit headphone 10 in a 
separate place from the other place, a manipulator (magic hand) that enables 
visual and auditory perception with a sense of direction and an enhanced 
realism can be provided. 

[0018] While in the description of the third embodiment, drive circuits 1* to 5' 
that are arranged inside the headphone was mentioned, the intent of the 
present invention would not be impaired even if these drive circuits 1' to 5* are 
arranged outside the headphone. Furthermore, drive circuits 1* to 5' may 
perform not only an amplification but also a sound processing. These sound 
signals may be stored at the same time. 
[0019] 

[Effects due to the Invention] As is clear from the above descriptions, the 
headphone apparatus according to this invention provides a headphone that 
enables easy and reliable sound localization in a simple configuration. While 
people have varied ear shapes and there are variations among individuals as 
to the sound localization, the headphone apparatus of this invention also 
provides a headphone that enables sound localization, and keeps the ears of 
varied shapes intact by not pressing hard against them. With a combined 
use of a head mount display, a virtual-reality audio-visual apparatus with an 
enhanced reality can be provided. 

[Brief Description of the Drawings] 

[Fig. 1] A diagram of a set of headphones according to the first embodiment. 
[Fig. 2] A diagram of a configuration according to the first embodiment. 
[Fig. 3] A diagram of a configuration according to the second embodiment. 
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[Fig. 4] A diagram of a set of headphones according to the third embodiment. 
[Fig. 5] A diagram that explains operations according to the first embodiment. 
[Description of Signs] 

1 to 9 are speakers, 1' to 5* are drive circuits, 1" to 5" are microphones, 10 is a 
unit headphone, 11 are drive circuits, 12 is a computer, 13 is a position and 
direction detection unit, 14 is a head mount display, and L, L', R, R' are left 
and right headphones, respectively. 

Fig. 1 

10 Unit Headphone 

Ear 

I to 5 Speakers 

A set of headphones according to the First Embodiment 
Fig. 2 

10 Unit Headphone 

12 Computer 
Monophonic Sound Signal 

I I Drive Circuits 

Configuration according to the First Embodiment 
Fig. 3 

10 Unit Headphone 

13 Position and Direction Detection Unit 
Right Eye Vision 
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Left Eye Vision 
12 Computer 
Monophonic Sound Signal 
11 Drive Circuits 

Configuration according to the Second Embodiment 
Fig. 4 

10' Unit Headphone 

1 to 5 Speakers 
1'to5' Drive Circuits 
1" to 5" Microphones 

A set of headphone according to the Third Embodiment 
Fig. 5 

Virtual Room 

Sound Source 

Wall 

Person 

Speaker Operation 

Operational Illustration according to the First Embodiment 
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